Building an infrastructure to support the development, conduct, and reporting of informative clinical studies: The Rockefeller University experience.

Introduction: Clinical trials are a vital component of translational science, providing crucial information on the efficacy and safety of new interventions and forming the basis for regulatory approval and/or clinical adoption. At the same time, they are complex to design, conduct, monitor, and report successfully. Concerns over the last two decades about the quality of the design and the lack of completion and reporting of clinical trials, characterized as a lack of "informativeness," highlighted by the experience during the COVID-19 pandemic, have led to several initiatives to address the serious shortcomings of the United States clinical research enterprise. Methods and Results: Against this background, we detail the policies, procedures, and programs that we have developed in The Rockefeller University Center for Clinical and Translational Science (CCTS), supported by a Clinical and Translational Science Award (CTSA) program grant since 2006, to support the development, conduct, and reporting of informative clinical studies. Conclusions: We have focused on building a data-driven infrastructure to both assist individual investigators and bring translational science to each element of the clinical investigation process, with the goal of both generating new knowledge and accelerating the uptake of that knowledge into practice.

The Rockefeller Team Science Leadership training program: Curriculum, standardized assessment of competencies, and impact of returning assessments.

The ability to effectively lead an interdisciplinary translational team is a crucial component of team science success. Most KL2 Clinical Scholars have been members of scientific teams, but few have been team science leaders. There is a dearth of literature and outcome measures of effective Team Science Leadership in clinical and translational research. We focused our curriculum to emphasize Team Science Leadership, developed a list of Team Science Leadership competencies for translational investigators using a modified Delphi method, and incorporated the competencies into a quantitative evaluation survey. The survey is completed on entry and annually thereafter by the Scholar; the Scholar's primary mentor and senior staff who educate and interact with the Scholar rate the Scholar at the end of each year. The program leaders and mentor review the results with each Scholar. The survey scales had high internal consistency and good factor structure. Overall ratings by mentors and senior staff were generally high, but ratings by Scholars tended to be lower, offering opportunities for discussion and career planning. Scholars rated the process favorably. A Team Science Leadership curriculum and periodic survey of attained competencies can inform individual career development and guide team science curriculum development.

The Rockefeller University Clinical Scholars (KL2) Program 2006-2016.

INTRODUCTION AND METHODS: The Rockefeller Clinical Scholars (KL2) Program began in 1976 and transitioned into a 3-year Master's degree program in 2006 when Rockefeller joined the NIH Clinical and Translational Science Award (CTSA) program. The program consists of ~15 trainees supported by the CTSA KL2 award and University funds. It is designed to provide an optimal environment for junior translational investigators to develop team science and leadership skills by designing and performing a human subjects protocol under the supervision of a distinguished senior investigator mentor and a team of content expert educators. This is complemented by a tutorial focused on important translational skills. RESULTS: Since 2006, 40 Clinical Scholars have graduated from the programs and gone on to careers in academia (72%), government service (5%), industry (15%), and private medical practice (3%); two (5%) remain in training programs. 39/40 remain in translational research careers with 23 NIH awards totaling $23 million, foundation and philanthropic support of $20.3 million, and foreign government and foundation support of $6 million. They have made wide ranging scientific discoveries and have endeavored to translate those discoveries into improved human health. CONCLUSION: The Rockefeller Clinical Scholars (KL2) program provides one model for translational science training.

The Rockefeller University Graduate Tracking Survey System.

BACKGROUND: It is essential to track the careers and accomplishments of the graduates of translational research training programs to assess the impact of the programs and to improve them. The major obstacle is the lack of a convenient method to collect the information in a comprehensive and standardized manner. METHODS: We have developed a Web-based electronic Graduate Tracking Survey System (GTSS) that prepopulates the graduate's information on publications, grants, patents, and clinical trials from public data sources, thus insuring a uniform data format, facilitating survey completion, and facilitating the aggregation of data at individual or multiple sites. GTSS questions are designed to assess whether trainees make important contributions that improve human health, and to track related "surrogate" career development indicators of likely future success. RESULTS: The GTSS has been in use at Rockefeller University since 2011 and has been adopted by 21 other Clinical and Translational Science Award programs. CONCLUSIONS: The GTSS provides an efficient and convenient mechanism to track the graduates of a wide variety of training programs. It has the potential to aggregate standardized data across institutions, thus providing benchmarks for the assessment of individual training programs and data for program improvement.